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The evaluation of educatioiial |>rograias is often 
» inconsistent with the need for imaginative innovations for 
educational improvement. Premature evaluation, preoccupation with 
* "hard delta" developed by the mass use of standardized tests, concern 
- only for final results^ laqlt of imagination, requirements that all 
projects in a program make provisions for evaluation, and a tendency 
to construe tentative findings as proof add' to the failure of many 
- educational evaluations. The need for sensible programs concerning 
. ' Evaluations is one" of the major issues in^ American education, 
(Author/SE). f 
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NATIONAL ADVISORY COUNCIL ON EDUCATION PROFESSIONS DEVELOPMENT 
Evaluation of Educational Programs 

Evaluation of the wrong kind, at the wrong time, and f^r ttjp ^rong 
reasons has characterized too much of the current effort to ^appraise edv- 
cational reforms. Meaningless evaluation is ruining' the cutting edge of 
educational innovation. 

Fundamental and lasting improvements in education are most ''kely to 

develop if schools, colleges, and other educational settings are provided 
the stimulus and the resoui^es to explore new ways, to experiment with new 
ideas, to attack educational problems with imagination and daring. Such an 
approach offers the greatest prospect for wide-spread and penetrating inno- 
vation. } 

It is becoming increasingly clear that a number of policies and practices 
related to evaluation are not consistent with thi s approach , and are having 

s 
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an adverse effect on efforts to provide genuine innovation and improvement. 
Among such-practices and policies, we cite for special note the following: 
. . . premature evaluation. Probably nothing violates common 
sense more than evaluation of an educational venture before it 
is operating on a basis wher^ there- is any reasonable possibility 
of tangible results. If anything is clear, it is that complex 
• educational problems do not yield to even extraordinary effort In 
' a short period of time. In such cases, a substantial period of 
planning is required. In addition, before the project can become 
operational, provisions must be made for the recruitment and train- 
ing of new personnel and the retraining of existing personnel; the 
I development of cuijricuTum; the acquisition of equipment; the 
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development of new organizational arrangements; the Involvement of 
parents and community; the working out of new relationships between 
the school and university. Finally, a project needs a period in 
which these new resources and arrangements can be brought together 
ar worl<ed out on a day-to-day basis. To conduct an evaluation 
before these conditions are met is to waste both time and money.. 

. - ■ a1mQ<;i: total preoccupation w ith so-called "hard data" 
developed by mass use of standardi zed tests . Such test results 
are a legitimate and very Useful type of evidence. But thls^ls 
only one kind of evidence! To capture a full sense of what Is^ 
•being accomplished in a project, a-^iety^f evaluation techniques 
should be employed. The case approach , (appl led either to a total 
project or to Individuals affected by It), Interviews, observation, 
even a sensiti\j|ly written description of an activity will reveal 
kinds of Information which are as essential as test scores , 1 n coming- 
to a judgment about the progress or accomplishments of an endeavor. 
Each of these evaluation techniques can make a contribution In Its 
own right. In addition, they can serve as correctives to the limita- 
tions of any one type of evaluation. Mmittedly, the collection of 
objective data is convenient and economical. However, neither 
convenience nor economy should be the sole criterion of carrying 
out an evaluation. 

. concern onlv for final results with little ef fort to determine 
why thfe object ives oF a project were or were no t achieved. In too 
many Instances, evaluation represents something that is akin to a 



a mania for data collection. Not enough attention Is given to 
understanding factors, that shape the outcome. Such insights are 
crucial. If a given project appears to have promise, those who 
would like to undertake a similar venture need to know not only 
that "it works"; they also need to know something of those factors 
which contributed to this positive outcome. Similarly, if a project 

V 

does pot appear to be realizing its objectives. Its sponsors need 
to know what the difficulties are so that a judgment about modifi- 
cations, or consideration of^ totally different alternatives, may 
be made on a rational basis. It Is little wonder that so few 
evaluations are taken? seriously ; they are simply not Informing. 

. ■ ■ lack of Imagination in selecting types of evaluation ..that 
are applicable to the special nature or purposes of an educational. 
activ ity, or to Its stage of development. 

. . . requirements that all prolects In a program make provisions 
for evaluation . Many — perhaps most — are granted barely enough 
funds for operating costs. Devoting scarce funds to a full-scale 
evaluation In such circumstances just does not make sense. 

j . a tendency to construe tenptlve findings as lipmaf ." There 
ap'^ears to be a compulsion to label an educational endeavor as either 
a "dramatic success" or a "dismal failure." Neither our knowledge 
about education nor the state of the art In evaluation warrants such 
conclusions for many types of programs. 



The cumuli^iveVfjct of these ill-considered policies and practices Is 
serious. Because of pressures to evaluate, the attentjon of those responsible 
for projects is diverted from the central task of achieving the objectives of 
the project. Superficial evaluation often result In contradictory Evidence 
which confuses the public and undercuts support for educational programs. If 
evaluations are undertaken too early in the development of a project, project ^ 
sponsors may become Inclined to strike for "Instant results" rather than attack- 
ing fundamental problems in order to produce lasting improvement. 

In its second annual report, submitted earlier this year to the President 
and the Congress, this Council devoted a major section to research and evalua- 
tion. It has expanded on Its statements in that report at this time because 
the need for sensible policies concerning evaluation of educational programs 
Is rapidly emerging as one of the- major issues In American education. 



